Detailed conclusion table per each integral is given by the table below. The elapsed time is in seconds. For failed result it is given as F(-1) if the failure was due to timeout. It is given as F(-2) if the failure was due to an exception being raised, which could indicate a bug in the system. If the failure was due to integral not being evaluated within the time limit, then it is given as F.
In this table, the column N.S. means normalized size and is defined as \(\frac {\text {antiderivative leaf size}}{\text {optimal antiderivative leaf size}}\). To make the table fit the page, the name Mathematica was abbreviated to MMA
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | A | F | C | F(-1) | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 215 | 215 | 1108 | 360 | 0 | 245 | 0 | 0 | 269 |
| N.S. |
1 | 1.00 | 5.15 | 1.67 | 0.00 | 1.14 | 0.00 | 0.00 | 1.25 |
| time (sec) |
N/A | 0.759 | 10.289 | 144.858 | 0.000 | 0.117 | 0.000 | 0.000 | 18.093 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 211 | 211 | 1089 | 704 | 0 | 247 | 0 | 0 | 237 |
| N.S. |
1 | 1.00 | 5.16 | 3.34 | 0.00 | 1.17 | 0.00 | 0.00 | 1.12 |
| time (sec) |
N/A | 0.688 | 11.573 | 141.441 | 0.000 | 0.120 | 0.000 | 0.000 | 19.578 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 213 | 213 | 1085 | 939 | 0 | 253 | 0 | 0 | 279 |
| N.S. |
1 | 1.00 | 5.09 | 4.41 | 0.00 | 1.19 | 0.00 | 0.00 | 1.31 |
| time (sec) |
N/A | 0.687 | 12.691 | 2.868 | 0.000 | 0.118 | 0.000 | 0.000 | 19.538 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 213 | 213 | 1102 | 985 | 0 | 259 | 0 | 0 | 279 |
| N.S. |
1 | 1.00 | 5.17 | 4.62 | 0.00 | 1.22 | 0.00 | 0.00 | 1.31 |
| time (sec) |
N/A | 0.737 | 13.409 | 3.575 | 0.000 | 0.127 | 0.000 | 0.000 | 20.708 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 246 | 246 | 1135 | 1219 | 0 | 279 | 0 | 0 | 308 |
| N.S. |
1 | 1.00 | 4.61 | 4.96 | 0.00 | 1.13 | 0.00 | 0.00 | 1.25 |
| time (sec) |
N/A | 0.769 | 12.854 | 4.788 | 0.000 | 0.118 | 0.000 | 0.000 | 21.360 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F(-1) | C | F | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 279 | 279 | 1179 | 1381 | 0 | 299 | 0 | 0 | 621 |
| N.S. |
1 | 1.00 | 4.23 | 4.95 | 0.00 | 1.07 | 0.00 | 0.00 | 2.23 |
| time (sec) |
N/A | 0.880 | 13.057 | 5.658 | 0.000 | 0.136 | 0.000 | 0.000 | 21.559 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | A | F | C | F(-1) | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 192 | 192 | 1155 | 295 | 0 | 280 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 6.02 | 1.54 | 0.00 | 1.46 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.324 | 9.685 | 10.031 | 0.000 | 0.118 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | A | F | C | F(-1) | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 159 | 159 | 1107 | 277 | 0 | 263 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 6.96 | 1.74 | 0.00 | 1.65 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.293 | 8.309 | 9.352 | 0.000 | 0.117 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | A | F | C | F(-1) | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 122 | 122 | 1059 | 262 | 0 | 250 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 8.68 | 2.15 | 0.00 | 2.05 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.270 | 8.332 | 2.873 | 0.000 | 0.108 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | A | F | C | F | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 84 | 84 | 1030 | 245 | 0 | 239 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 12.26 | 2.92 | 0.00 | 2.85 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.244 | 9.611 | 1.877 | 0.000 | 0.101 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | A | F | C | F | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 112 | 112 | 1063 | 316 | 0 | 288 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 9.49 | 2.82 | 0.00 | 2.57 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.277 | 9.227 | 1.558 | 0.000 | 0.103 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F(-1) | C | F | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 150 | 150 | 1097 | 459 | 0 | 314 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 7.31 | 3.06 | 0.00 | 2.09 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.302 | 9.110 | 2.031 | 0.000 | 0.112 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 192 | 192 | 1144 | 776 | 0 | 333 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 5.96 | 4.04 | 0.00 | 1.73 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.321 | 9.832 | 2.629 | 0.000 | 0.120 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | A | F | C | F(-1) | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 196 | 196 | 1162 | 451 | 0 | 378 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 5.93 | 2.30 | 0.00 | 1.93 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.462 | 9.205 | 6.048 | 0.000 | 0.117 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 161 | 161 | 1119 | 437 | 0 | 366 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 6.95 | 2.71 | 0.00 | 2.27 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.464 | 9.693 | 3.211 | 0.000 | 0.123 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 130 | 130 | 816 | 352 | 0 | 318 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 6.28 | 2.71 | 0.00 | 2.45 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.428 | 9.426 | 2.995 | 0.000 | 0.109 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 125 | 125 | 1086 | 423 | 0 | 354 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 8.69 | 3.38 | 0.00 | 2.83 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.423 | 11.456 | 2.016 | 0.000 | 0.108 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F(-1) | C | F(-1) | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 151 | 151 | 836 | 450 | 0 | 367 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 5.54 | 2.98 | 0.00 | 2.43 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.444 | 11.411 | 1.885 | 0.000 | 0.110 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 189 | 189 | 1155 | 711 | 0 | 427 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 6.11 | 3.76 | 0.00 | 2.26 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.452 | 10.296 | 2.295 | 0.000 | 0.110 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | A | F | C | F(-1) | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 250 | 250 | 1271 | 479 | 0 | 489 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 5.08 | 1.92 | 0.00 | 1.96 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.639 | 11.369 | 13.040 | 0.000 | 0.149 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | A | F | C | F(-1) | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 209 | 209 | 1234 | 465 | 0 | 478 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 5.90 | 2.22 | 0.00 | 2.29 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.602 | 11.185 | 3.604 | 0.000 | 0.135 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 186 | 186 | 1210 | 451 | 0 | 467 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 6.51 | 2.42 | 0.00 | 2.51 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.634 | 9.052 | 3.469 | 0.000 | 0.120 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 184 | 184 | 1203 | 451 | 0 | 467 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 6.54 | 2.45 | 0.00 | 2.54 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.598 | 8.932 | 3.284 | 0.000 | 0.118 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F(-1) | C | F(-1) | F | F(-1) |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 180 | 180 | 1200 | 451 | 0 | 465 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 6.67 | 2.51 | 0.00 | 2.58 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.569 | 10.695 | 3.153 | 0.000 | 0.116 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F(-1) | C | F(-1) | F | F(-1) |
| verified |
N/A | Yes | No | No | TBD | TBD | TBD | TBD | TBD |
| size | 209 | 209 | 1237 | 679 | 0 | 515 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 5.92 | 3.25 | 0.00 | 2.46 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.615 | 9.421 | 2.425 | 0.000 | 0.131 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F(-1) | C | F(-1) | F | F(-1) |
| verified |
N/A | Yes | No | No | TBD | TBD | TBD | TBD | TBD |
| size | 242 | 242 | 1269 | 876 | 0 | 542 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 5.24 | 3.62 | 0.00 | 2.24 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.624 | 11.493 | 2.616 | 0.000 | 0.147 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 213 | 213 | 109 | 106 | 507 | 110 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.51 | 0.50 | 2.38 | 0.52 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.700 | 0.492 | 0.687 | 0.469 | 0.294 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 168 | 168 | 90 | 87 | 387 | 92 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.54 | 0.52 | 2.30 | 0.55 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.624 | 0.349 | 0.645 | 0.442 | 0.278 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 122 | 122 | 68 | 67 | 231 | 76 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.56 | 0.55 | 1.89 | 0.62 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.515 | 0.306 | 0.627 | 0.465 | 0.288 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 136 | 136 | 89 | 193 | 355 | 323 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.65 | 1.42 | 2.61 | 2.38 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.498 | 1.858 | 0.776 | 0.452 | 0.305 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 135 | 135 | 92 | 205 | 731 | 355 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 1.52 | 5.41 | 2.63 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.477 | 2.776 | 0.761 | 0.477 | 0.302 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 144 | 144 | 145 | 315 | 1507 | 391 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 1.01 | 2.19 | 10.47 | 2.72 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.493 | 0.717 | 0.760 | 0.499 | 0.334 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 189 | 189 | 170 | 377 | 2740 | 427 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.90 | 1.99 | 14.50 | 2.26 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.614 | 1.042 | 0.710 | 0.562 | 0.332 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 234 | 234 | 203 | 439 | 4417 | 461 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.87 | 1.88 | 18.88 | 1.97 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.719 | 2.382 | 0.731 | 0.755 | 0.355 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 266 | 266 | 125 | 127 | 652 | 136 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.47 | 0.48 | 2.45 | 0.51 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.977 | 7.288 | 0.628 | 0.501 | 0.297 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 219 | 219 | 109 | 107 | 544 | 117 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.50 | 0.49 | 2.48 | 0.53 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.850 | 2.345 | 0.587 | 0.466 | 0.273 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 169 | 169 | 91 | 88 | 368 | 98 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.54 | 0.52 | 2.18 | 0.58 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.635 | 1.624 | 0.771 | 0.468 | 0.280 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 183 | 183 | 112 | 248 | 694 | 367 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.61 | 1.36 | 3.79 | 2.01 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.713 | 1.991 | 0.840 | 0.479 | 0.303 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 189 | 189 | 118 | 237 | 1354 | 393 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.62 | 1.25 | 7.16 | 2.08 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.745 | 6.511 | 0.833 | 0.476 | 0.319 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 191 | 191 | 115 | 347 | 2520 | 423 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.60 | 1.82 | 13.19 | 2.21 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.729 | 6.537 | 0.833 | 0.549 | 0.369 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 191 | 191 | 197 | 378 | 3506 | 437 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 1.03 | 1.98 | 18.36 | 2.29 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.725 | 5.501 | 0.852 | 0.585 | 0.339 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 238 | 238 | 203 | 440 | 5761 | 469 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.85 | 1.85 | 24.21 | 1.97 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.907 | 6.413 | 0.865 | 0.801 | 0.376 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 285 | 285 | 176 | 502 | 7235 | 509 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.62 | 1.76 | 25.39 | 1.79 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.961 | 12.020 | 0.921 | 1.194 | 0.376 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 313 | 313 | 148 | 149 | 852 | 168 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.47 | 0.48 | 2.72 | 0.54 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 1.226 | 6.246 | 0.513 | 0.502 | 0.294 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 266 | 266 | 133 | 136 | 695 | 146 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.50 | 0.51 | 2.61 | 0.55 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 1.131 | 2.689 | 0.394 | 0.498 | 0.275 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 216 | 216 | 111 | 114 | 580 | 127 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.51 | 0.53 | 2.69 | 0.59 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.772 | 2.847 | 0.398 | 0.479 | 0.294 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 230 | 230 | 129 | 310 | 849 | 429 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.56 | 1.35 | 3.69 | 1.87 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.912 | 4.510 | 0.815 | 0.543 | 0.314 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 230 | 230 | 132 | 299 | 8175 | 453 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.57 | 1.30 | 35.54 | 1.97 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.953 | 3.601 | 0.434 | 0.781 | 0.314 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 244 | 244 | 157 | 380 | 3421 | 473 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.64 | 1.56 | 14.02 | 1.94 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.985 | 6.980 | 0.899 | 3.373 | 0.358 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 238 | 238 | 133 | 411 | 14964 | 485 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.56 | 1.73 | 62.87 | 2.04 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.959 | 8.132 | 0.890 | 0.747 | 0.355 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 238 | 238 | 166 | 442 | 6687 | 497 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.70 | 1.86 | 28.10 | 2.09 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.954 | 7.663 | 0.908 | 3.492 | 0.370 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 285 | 285 | 479 | 504 | 8852 | 537 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 1.68 | 1.77 | 31.06 | 1.88 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 1.178 | 11.727 | 0.982 | 1.291 | 0.379 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 332 | 332 | 498 | 566 | 11081 | 577 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 1.50 | 1.70 | 33.38 | 1.74 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 1.200 | 13.016 | 1.099 | 2.100 | 0.365 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 244 | 244 | 166 | 358 | 671 | 384 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.68 | 1.47 | 2.75 | 1.57 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 1.003 | 2.105 | 0.492 | 0.486 | 0.301 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 201 | 201 | 153 | 326 | 553 | 352 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.76 | 1.62 | 2.75 | 1.75 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.739 | 0.618 | 0.674 | 0.481 | 0.312 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 156 | 156 | 120 | 190 | 373 | 322 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.77 | 1.22 | 2.39 | 2.06 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.550 | 1.739 | 0.674 | 0.471 | 0.298 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 175 | 175 | 128 | 248 | 712 | 489 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.73 | 1.42 | 4.07 | 2.79 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.592 | 1.413 | 0.808 | 0.494 | 0.318 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 173 | 173 | 190 | 275 | 18526 | 542 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 1.10 | 1.59 | 107.09 | 3.13 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.613 | 0.470 | 0.789 | 0.616 | 0.335 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 223 | 223 | 224 | 418 | 2304 | 601 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 1.00 | 1.87 | 10.33 | 2.70 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.856 | 0.822 | 0.745 | 0.527 | 0.333 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 266 | 266 | 280 | 480 | 3766 | 638 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 1.05 | 1.80 | 14.16 | 2.40 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 1.017 | 1.596 | 0.769 | 0.664 | 0.389 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | F(-2) | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 268 | 268 | 162 | 486 | 0 | 468 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.60 | 1.81 | 0.00 | 1.75 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 1.041 | 4.305 | 0.771 | 0.000 | 0.307 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 221 | 221 | 163 | 340 | 34992 | 434 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.74 | 1.54 | 158.33 | 1.96 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.801 | 2.502 | 0.757 | 0.932 | 0.299 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 172 | 172 | 339 | 309 | 8312 | 406 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 1.97 | 1.80 | 48.33 | 2.36 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.582 | 5.850 | 0.758 | 0.567 | 0.294 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 185 | 185 | 219 | 472 | 3153 | 600 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 1.18 | 2.55 | 17.04 | 3.24 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.679 | 6.092 | 0.823 | 0.593 | 0.330 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 228 | 228 | 447 | 537 | 63653 | 668 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 1.96 | 2.36 | 279.18 | 2.93 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.849 | 7.105 | 0.824 | 2.407 | 0.337 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | B | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 285 | 285 | 731 | 792 | 10551 | 754 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 2.56 | 2.78 | 37.02 | 2.65 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 1.076 | 7.972 | 0.835 | 1.314 | 0.389 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | No | TBD | TBD | TBD | TBD | TBD |
| size | 315 | 315 | 183 | 775 | 243716 | 564 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.58 | 2.46 | 773.70 | 1.79 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 1.325 | 5.147 | 0.600 | 5.355 | 0.338 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 266 | 266 | 175 | 500 | 151873 | 530 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 0.66 | 1.88 | 570.95 | 1.99 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 1.075 | 3.698 | 0.839 | 3.183 | 0.328 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | No | TBD | TBD | TBD | TBD | TBD |
| size | 219 | 219 | 321 | 553 | 261332 | 500 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 1.47 | 2.53 | 1193.30 | 2.28 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.846 | 5.594 | 0.832 | 3.227 | 0.302 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | B | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 174 | 174 | 566 | 438 | 5530 | 482 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 3.25 | 2.52 | 31.78 | 2.77 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.605 | 10.243 | 0.784 | 0.877 | 0.294 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | B | B | B | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | No | TBD | TBD | TBD | TBD | TBD |
| size | 232 | 232 | 698 | 690 | 7863 | 716 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 3.01 | 2.97 | 33.89 | 3.09 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 0.883 | 8.870 | 0.857 | 0.881 | 0.342 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | B | B | F(-2) | A | F(-1) | F | F(-1) |
| verified |
N/A | Yes | Yes | No | TBD | TBD | TBD | TBD | TBD |
| size | 277 | 277 | 813 | 949 | 0 | 800 | 0 | 0 | 0 |
| N.S. |
1 | 1.00 | 2.94 | 3.43 | 0.00 | 2.89 | 0.00 | 0.00 | 0.00 |
| time (sec) |
N/A | 1.104 | 7.661 | 0.869 | 0.000 | 0.354 | 0.000 | 0.000 | 0.000 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | F | C | F(-1) | F | B |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 111 | 111 | 77 | 290 | 0 | 148 | 0 | 0 | 87 |
| N.S. |
1 | 1.00 | 0.69 | 2.61 | 0.00 | 1.33 | 0.00 | 0.00 | 0.78 |
| time (sec) |
N/A | 0.117 | 1.525 | 12.477 | 0.000 | 0.113 | 0.000 | 0.000 | 18.384 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 87 | 87 | 66 | 262 | 0 | 137 | 0 | 0 | 80 |
| N.S. |
1 | 1.00 | 0.76 | 3.01 | 0.00 | 1.57 | 0.00 | 0.00 | 0.92 |
| time (sec) |
N/A | 0.109 | 0.368 | 12.058 | 0.000 | 0.109 | 0.000 | 0.000 | 17.964 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 53 | 228 | 0 | 125 | 0 | 0 | 53 |
| N.S. |
1 | 1.00 | 0.87 | 3.74 | 0.00 | 2.05 | 0.00 | 0.00 | 0.87 |
| time (sec) |
N/A | 0.098 | 0.222 | 11.117 | 0.000 | 0.104 | 0.000 | 0.000 | 0.188 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | F | C | F(-1) | F | B |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 35 | 35 | 35 | 152 | 0 | 107 | 0 | 0 | 33 |
| N.S. |
1 | 1.00 | 1.00 | 4.34 | 0.00 | 3.06 | 0.00 | 0.00 | 0.94 |
| time (sec) |
N/A | 0.074 | 0.181 | 0.875 | 0.000 | 0.094 | 0.000 | 0.000 | 0.252 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | A | F | C | F | F | B |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 57 | 57 | 51 | 148 | 0 | 156 | 0 | 0 | 60 |
| N.S. |
1 | 1.00 | 0.89 | 2.60 | 0.00 | 2.74 | 0.00 | 0.00 | 1.05 |
| time (sec) |
N/A | 0.080 | 0.267 | 0.887 | 0.000 | 0.103 | 0.000 | 0.000 | 18.515 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | F | C | F | F | B |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 83 | 83 | 65 | 396 | 0 | 175 | 0 | 0 | 87 |
| N.S. |
1 | 1.00 | 0.78 | 4.77 | 0.00 | 2.11 | 0.00 | 0.00 | 1.05 |
| time (sec) |
N/A | 0.103 | 0.634 | 1.671 | 0.000 | 0.107 | 0.000 | 0.000 | 18.068 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | F | C | F | F | B |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 111 | 111 | 95 | 502 | 0 | 188 | 0 | 0 | 87 |
| N.S. |
1 | 1.00 | 0.86 | 4.52 | 0.00 | 1.69 | 0.00 | 0.00 | 0.78 |
| time (sec) |
N/A | 0.108 | 0.535 | 2.302 | 0.000 | 0.102 | 0.000 | 0.000 | 18.674 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 123 | 123 | 86 | 342 | 0 | 163 | 0 | 0 | 123 |
| N.S. |
1 | 1.00 | 0.70 | 2.78 | 0.00 | 1.33 | 0.00 | 0.00 | 1.00 |
| time (sec) |
N/A | 0.156 | 2.877 | 12.666 | 0.000 | 0.097 | 0.000 | 0.000 | 18.101 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 93 | 93 | 72 | 308 | 0 | 149 | 0 | 0 | 96 |
| N.S. |
1 | 1.00 | 0.77 | 3.31 | 0.00 | 1.60 | 0.00 | 0.00 | 1.03 |
| time (sec) |
N/A | 0.152 | 2.093 | 12.091 | 0.000 | 0.097 | 0.000 | 0.000 | 18.272 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 65 | 65 | 682 | 274 | 0 | 135 | 0 | 0 | 69 |
| N.S. |
1 | 1.00 | 10.49 | 4.22 | 0.00 | 2.08 | 0.00 | 0.00 | 1.06 |
| time (sec) |
N/A | 0.135 | 6.832 | 2.116 | 0.000 | 0.098 | 0.000 | 0.000 | 17.833 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | A | F | C | F | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 61 | 61 | 759 | 195 | 0 | 166 | 0 | 0 | 76 |
| N.S. |
1 | 1.00 | 12.44 | 3.20 | 0.00 | 2.72 | 0.00 | 0.00 | 1.25 |
| time (sec) |
N/A | 0.140 | 6.630 | 2.341 | 0.000 | 0.097 | 0.000 | 0.000 | 18.252 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | F | C | F | F | B |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 87 | 87 | 69 | 500 | 0 | 185 | 0 | 0 | 103 |
| N.S. |
1 | 1.00 | 0.79 | 5.75 | 0.00 | 2.13 | 0.00 | 0.00 | 1.18 |
| time (sec) |
N/A | 0.159 | 0.690 | 2.764 | 0.000 | 0.099 | 0.000 | 0.000 | 0.403 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | F | C | F | F | B |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 123 | 123 | 112 | 799 | 0 | 206 | 0 | 0 | 108 |
| N.S. |
1 | 1.00 | 0.91 | 6.50 | 0.00 | 1.67 | 0.00 | 0.00 | 0.88 |
| time (sec) |
N/A | 0.180 | 0.567 | 3.599 | 0.000 | 0.106 | 0.000 | 0.000 | 18.512 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | A | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | Yes | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 147 | 147 | 129 | 684 | 0 | 217 | 0 | 0 | 108 |
| N.S. |
1 | 1.00 | 0.88 | 4.65 | 0.00 | 1.48 | 0.00 | 0.00 | 0.73 |
| time (sec) |
N/A | 0.194 | 0.652 | 4.385 | 0.000 | 0.104 | 0.000 | 0.000 | 19.401 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 175 | 175 | 1292 | 512 | 0 | 223 | 0 | 0 | 254 |
| N.S. |
1 | 1.00 | 7.38 | 2.93 | 0.00 | 1.27 | 0.00 | 0.00 | 1.45 |
| time (sec) |
N/A | 0.359 | 6.741 | 27.148 | 0.000 | 0.122 | 0.000 | 0.000 | 18.470 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 142 | 142 | 1240 | 481 | 0 | 202 | 0 | 0 | 216 |
| N.S. |
1 | 1.00 | 8.73 | 3.39 | 0.00 | 1.42 | 0.00 | 0.00 | 1.52 |
| time (sec) |
N/A | 0.330 | 9.217 | 26.420 | 0.000 | 0.107 | 0.000 | 0.000 | 18.566 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 106 | 106 | 1186 | 447 | 0 | 173 | 0 | 0 | 162 |
| N.S. |
1 | 1.00 | 11.19 | 4.22 | 0.00 | 1.63 | 0.00 | 0.00 | 1.53 |
| time (sec) |
N/A | 0.279 | 7.206 | 25.851 | 0.000 | 0.103 | 0.000 | 0.000 | 0.483 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 98 | 98 | 1173 | 380 | 0 | 198 | 0 | 0 | 146 |
| N.S. |
1 | 1.00 | 11.97 | 3.88 | 0.00 | 2.02 | 0.00 | 0.00 | 1.49 |
| time (sec) |
N/A | 0.279 | 8.297 | 1.933 | 0.000 | 0.105 | 0.000 | 0.000 | 19.028 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 103 | 103 | 1180 | 488 | 0 | 212 | 0 | 0 | 184 |
| N.S. |
1 | 1.00 | 11.46 | 4.74 | 0.00 | 2.06 | 0.00 | 0.00 | 1.79 |
| time (sec) |
N/A | 0.287 | 8.152 | 2.099 | 0.000 | 0.105 | 0.000 | 0.000 | 19.667 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 141 | 141 | 1228 | 712 | 0 | 234 | 0 | 0 | 217 |
| N.S. |
1 | 1.00 | 8.71 | 5.05 | 0.00 | 1.66 | 0.00 | 0.00 | 1.54 |
| time (sec) |
N/A | 0.311 | 8.331 | 2.589 | 0.000 | 0.108 | 0.000 | 0.000 | 19.859 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F(-1) | C | F | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 177 | 177 | 1284 | 822 | 0 | 263 | 0 | 0 | 223 |
| N.S. |
1 | 1.00 | 7.25 | 4.64 | 0.00 | 1.49 | 0.00 | 0.00 | 1.26 |
| time (sec) |
N/A | 0.366 | 9.689 | 3.460 | 0.000 | 0.116 | 0.000 | 0.000 | 20.704 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | A | F(-1) | C | F(-1) | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 251 | 251 | 1364 | 545 | 0 | 264 | 0 | 0 | 404 |
| N.S. |
1 | 1.00 | 5.43 | 2.17 | 0.00 | 1.05 | 0.00 | 0.00 | 1.61 |
| time (sec) |
N/A | 0.677 | 8.216 | 48.857 | 0.000 | 0.121 | 0.000 | 0.000 | 19.144 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F(-1) | C | F(-1) | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 215 | 215 | 1699 | 514 | 0 | 241 | 0 | 0 | 369 |
| N.S. |
1 | 1.00 | 7.90 | 2.39 | 0.00 | 1.12 | 0.00 | 0.00 | 1.72 |
| time (sec) |
N/A | 0.630 | 10.202 | 48.011 | 0.000 | 0.113 | 0.000 | 0.000 | 18.494 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 179 | 179 | 1645 | 483 | 0 | 218 | 0 | 0 | 280 |
| N.S. |
1 | 1.00 | 9.19 | 2.70 | 0.00 | 1.22 | 0.00 | 0.00 | 1.56 |
| time (sec) |
N/A | 0.605 | 17.250 | 47.285 | 0.000 | 0.105 | 0.000 | 0.000 | 18.065 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 170 | 170 | 1356 | 595 | 0 | 231 | 0 | 0 | 237 |
| N.S. |
1 | 1.00 | 7.98 | 3.50 | 0.00 | 1.36 | 0.00 | 0.00 | 1.39 |
| time (sec) |
N/A | 0.605 | 12.877 | 45.921 | 0.000 | 0.115 | 0.000 | 0.000 | 18.389 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F(-1) | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 170 | 170 | 1342 | 800 | 0 | 237 | 0 | 0 | 245 |
| N.S. |
1 | 1.00 | 7.89 | 4.71 | 0.00 | 1.39 | 0.00 | 0.00 | 1.44 |
| time (sec) |
N/A | 0.627 | 15.195 | 2.320 | 0.000 | 0.108 | 0.000 | 0.000 | 19.199 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 174 | 174 | 1360 | 879 | 0 | 248 | 0 | 0 | 313 |
| N.S. |
1 | 1.00 | 7.82 | 5.05 | 0.00 | 1.43 | 0.00 | 0.00 | 1.80 |
| time (sec) |
N/A | 0.648 | 13.511 | 2.718 | 0.000 | 0.135 | 0.000 | 0.000 | 20.925 |
| Optimal | Rubi | MMA | Maple | Maxima | Fricas | Sympy | Giac | Mupad | |
| grade |
N/A | A | C | B | F | C | F | F | B |
| verified |
N/A | Yes | No | Yes | TBD | TBD | TBD | TBD | TBD |
| size | 215 | 215 | 1684 | 905 | 0 | 281 | 0 | 0 | 346 |
| N.S. |
1 | 1.00 | 7.83 | 4.21 | 0.00 | 1.31 | 0.00 | 0.00 | 1.61 |
| time (sec) |
N/A | 0.659 | 17.060 | 3.603 | 0.000 | 0.111 | 0.000 | 0.000 | 21.476 |